Month  Day ,  Year 


Implementing  Filters  to  Identify  and 
Prioritize  Industrial  Base  Risk:  Rules  of 
Thumb  to  Reduce  Cognitive  Overload 


May  2015 


Under  Secretary  of  Defense  for  Acquisition,  Technology  and  Logistics 

Manufacturing  &  Industrial  Base  Policy  Sally  Sleeper,  Ph.D. 

John  Starns,  D.Sc. 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

MAY  2015 

2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-2015  to  00-00-2015 

4.  TITLE  AND  SUBTITLE 

Implementing  Filters  to  Identify  and  Prioritize  Industrial  Base  Risk: 

Rules  of  Thumb  to  Reduce  Cognitive  Overload 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Under  Secretary  of  Defense  for  Acquisition,  Technology  and 

Logistics, Manufacturing  &  Industrial  Base  Policy, Washington, DC, 20301 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS (ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

Presented  at  the  12th  Annual  Acquisition  Research  Symposium  held  May  13-14,  2015  in  Monterey,  CA. 


14.  ABSTRACT 


15.  SUBJECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 
OF  PAGES 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

16 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Outline 


•  Background 

-  Risk  in  the  industrial  base 

-  Risk  assessment  process 

-  Continuous  improvement 

•  Filters  and  screens 

-  Purpose  and  application  to  industrial  base  assessment 

-  Examples 


USD(AT&L)  MIBP 


2 


Acquisition,  Technology  and  Logistics 
Manufacturing  and  Industrial  Base  Policy 


DASD(MIBP)  Andre  Gudger  (acting) 
PD(MIBP)  Mary  Margaret  Evans 

Ml  BP  supports  the  Office  of  the  Secretary  of  Defense 
and  Service  Acquisition  Executives  by  providing: 

•  Detailed  analyses  and  in-depth  understanding  of 
the  increasingly  global,  commercial,  and  financially 
complex  industrial  supply  chain  essential  to  our 
national  defense 

•  Recommendations  or  taking  appropriate  actions  to 
maintain  the  health,  integrity  and  technical 
superiority  of  that  supply  chain 


Programs 

Defense  Production  Act 

•  Title  I:  Defense  Priorities  and  Allocations 
System  (DPAS) 

•  Security  of  Supply 

•  Title  III:  Expanding  Production  Capability 
and  Supply 

•  Title  VII:  Committee  on  Foreign  Investment 
in  the  United  States 

U.S.  Code  Title  10  -  Armed  Forces 

•  Section  2521  of  Title  10,  Defense 
Manufacturing  Technology  Program 


MIBP  is  DoD’s  lead  in  all  matters  relating  to  mergers,  North  American  Technology  and  Industrial 

acquisitions,  and  dissolutions  of  national  security-  Base  0rganization  (NATIBO) 

related  business. 


MIBP  Mission:  Support  access  to  robust,  secure  and  innovative  industrial 
capabilities  to  fulfill  short-  and  long-term  National  Security  requirements 
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Constant  FY2014  Dollars  in  Billions 


Budget  Swings  Have  Significant  Consequences  for  the 
Industrial  Base 


DoD  Investment  Outlays 
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- Procurement 
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Contractors  &  their  vendors  during 

Upswings: 

•  Acquire  resources  to  address 
their  schedule  and  performance 
requirements 

•  Resources  may  be  limited  due  to 
demand 

Downswings: 

•  Decide  how  much  of  that 
capability  they  can  afford  to 
maintain  or 

•  Decide  to  exit  the  defense 
market 
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Will  Warfighter  Get  Support  When  Needed? 


•  Capitalism:  Markets  will  right-size  based  on  demand 

-  Companies  enter  when  it  is  profitable,  and  exit  otherwise 

•  Many  capabilities  used  by  defense  exist  during  upswings  and 
downswings 

-  Capabilities  “easy”  to  reproduce;  low  barriers  to  entry 

-  Market  has  alternatives  or  substitutes 

•  But  some  capabilities  are  sensitive  to  defense  procurement  swings 

-  Small  or  no  market  without  defense 

-  Little  slack  available  during  upswings 

-  Difficult  to  balance  capital  investments,  specialized  labor  with  large 
budget  changes 


Defense-specific  or  unique  capabilities  are  especially  sensitive  to  budget  changes 
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What  are  Risks  in  the  Industrial  Base? 


Risk  in  the  industrial  base  can  be: 

•  Involuntary  -  from  external  influences 

-  Defense  procurement  budget 

-  Congressional  mandates 

-  Emerging  National  Security  threats 

•  Voluntary  -  from  Defense  decision 
making 

-  Decisions  about  use  of  market  forces  to 
shape,  create,  and  sustain  industrial 
technologies  and  capabilities 

-  Decisions  about  when  and  how  to 
intervene 


Industry  provides  nearly  all  of  the  capabilities  required  by  the  warfighter 


Examples  of  IB  risks  to: 

•  Technical  superiority 

-  Loss  of  design  teams 

-  Lack  of  next-gen  technology 

-  Barriers  to  unique  technologies 

•  Affordable  products 

-  Lack  of  capacity  to  meet  requirements 

-  Absence  of  production  capability 

•  Supplier 

-  Sole  sources 

-  Financial  fragility 

-  Lack  of  interest  in  DoD 

•  Security  of  supply 

-  Foreign  dependencies 

-  External  investments 

•  Investment  and  transaction 

-  Reduced  competition 

-  Loss  of  domestic  IP 
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Process  for  Assessing  IB  Risk 


Process  Activity 


Action 


Outcome 


Select 

Sector/SubSector 

i. 

Search 

Available  Data 


* 

FaC  Screening/Filtering 


ji 

Conduct 

FaC  Matrix  Assessment 

Validate  &  Mitigate 

High  Risk  Issues;  Develop 
Mitigation  Strategy(ies) 


Scope  the  problem  (existing 
risk  assessments;  program 
shutdowns) 

Identify  IB-related  risks  & 
related  capabilities/products 
Identify  suppliers  and  market 

Focused  set  of  IB-related  risks 
for  further  assessment 


Facilitated  scoring,  based  on 
standardized  criteria,  by  SMEs 


SME  “deep  dive”  into  IB  risk 
areas;  facility  visits 


Preliminary  Sector  Taxonomy 


Expanded  Taxonomy  and 
Product  Supplier  Pairs 


Screened  IB/Issues 
Capability-Supplier  Pairs 


FaC  Risk  Matrix 


High  Risk  IB  Issues 


Statistical  tests  confirm  the  process  well-suited  to  assessing  a  portfolio  of 
suppliers  supporting  similar  capabilities,  and  deriving  cross-cutting  solutions 
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Final  Risk  Matrix  is  Scored  Using  Standard  Definitions 


Capability  =  technology,  part,  component,  product 


Criticality: 

•  Characteristics  that  make 
a  specific  Capability 
difficult  to  replace  if 
disrupted 


Fragility: 

•  Characteristics  that  make  a 
specific  Capability  likely  to 
be  disrupted 


p  < 

Defense  unique  capability 

Skilled  labor  requirements 
Defense  Design  requirements 
Facility  &  Equipment  requirements 

Reconstitution  time 

Availability  of  Alternatives _ 


- ' 

Financial  Outlook  (Current  provider) 

DoD  Sales  (Current  provider) 

Firms  in  Sector  (Existing  market) 

Foreign  Dependency  (Existing  market) 


Final  set  of  capabilities  assessed  in  the  risk  matrix 
is  pared  down  through  filters 
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Filtering  Out  Low-Risk  Concerns  Quickly  is  Essential 


Select 

The  Sector/Programs 


Search 

Available  Data 


FaC  Screening  / 
Filtering 


Conduct 

Risk  Matrix  Assessment 


k 


Appropriate  filters  -  manual  or  automated  -  help  focus  attention  on  areas  of 

highest  risk  and  prioritize  scarce  resources 
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Example:  Scoping  the  Assessment  Using  a  Taxonomy 


Industrial  Sector 


Second  FaC 
Assessment 
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Refining  the  Scope  of  the  Assessment 


Acquisition  Program 


Documented 

Taxonomy 


FaC 

Assessment 
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Example:  High-Level  Filters  to  Identify  Areas  of 
Concern 


Typical  Screens  for  DoD  IB  areas  of  risk 
applied  to  sector  taxonomy: 


•  Operational  impact  of  capability 
(pervasiveness  across  the  DoD  or  platforms) 

•  Low  commercial  market  demand  (few  or 
limited  applications) 

•  Change  in  DoD  demand  expected  over  the 
FYDP  (up  or  down) 

•  Rapid  rate  of  technical  change  expected 
(rapid  advancement  or  obsolescence) 

•  Limited  sources  of  supply  (domestic,  foreign) 

•  Anticipated  future  generation  system 
requirements  (next-gen) 


High-level  filters  are  adaptable  to  the  sector  and  focus  on  the  types  of  risk  to  e.g., 

superiority,  security  of  supply,  suppliers 
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Example  of  an  Initial  Screening  Exercise  (notional) 


High-Level  Screen 

Subsystem:  Ejection  System 

Propulsion:  Engine 

Operational  impact 
of  capability 

Yes:  multi-Service  requirement-  Yes:  multi-Service  requirement  - 
Operational  impact  of  capability  Operational  impact  of  capability 

cross-DoD  cross-DoD 

Low  commercial 

market  demand 

No:  commercial  market  for  aircraft 

Yes:  primarily  defense  market  engine, 

Yes:  tactical  aircraft  have 

specialized  requirements 

Change  in  DoD 
demand  expected 
over  the  FYDP 

Yes:  overall  procurement 

,  ,  Yes:  overall  procurement 

decrease;  no  requirement  for 

decrease 

UAV 

Rapid  rate  of 
technical  change 
expected 

Unknown:  technology  evolves  to  No:  next  generation  requirements 
improve  survivability  -  neither  will  drive  change;  not  commercial 

rapid  nor  slow  or  current  DoD  demand 

Limited  sources  of 
supply 

w  ,  ^  ^  ,  ,  No:  commercial  market  for  aircraft 

Yes:  decreasing  DoD  demand 

and  limited  commercial  demand  ®n9|ne> 

Yes:  tactical  aircraft  have 
may  limit  sources  . 

specialized  requirements 

Anticipated  future 
generation  system 
requirements 

Unknown/yes:  next-gen  aircraft  Yes:  next-gen  tactical  aircraft 

likely  to  require  advanced  likely  to  require  advanced 

systems  systems 

Structure 


:uselage 


'Vings 


cb  tj]  h 

V1 
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Screens  Based  on  DoD  Trends  Reveal  Areas  of  Concern 


Program 
Program  1 
Program  2 
Program3 
Program  4 
Program  5 
Programs 
Program? 


Programs 


Program  n  <  j 


New  Program 


Des'gn 


Production 


Operations  and  Sustainment 


Unit-independent  filter  for  risk  to  production,  R&D  facilities  and  skills 
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Screens  Based  on  DoD  Trends  Reveal  Areas  of  Concern 


Time 


FYDP 


Funded  Programs  in 
a  sector 


Unit-dependent  filter  for  cross-cutting  risk 
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Filters  Enable  Manageable  Assessment,  with  Caveats 


•  Pros: 

-  Adaptable 

-  Fast 

-  Prioritize  resources 

•  Cons: 

-  Will  miss  areas  of  concern,  by  design 

-  Rely  on  SME  interpretation 

•  Next  steps: 

-  Continue  to  refine  existing  filters 

-  Develop  new  ones  to  respond  to  environmental  and  strategic 
thrusts  of  the  Department 
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